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Starting  with  the  early  work  of  Burns  and  Stalker  (4),  Woodward  (18), 
Lawrence  and  Lorsch  (15),  and  Thompson  (16)  there  has  been  Increasing  Interest  In 
the  Idea  that  uncertainty  plays  an  Important  role  In  organizational  effective- 
ness. Essentially,  It  Is  argued  that  to  perform  effectively,  an  organization, 

Its  Internal  structure,  and  Its  decision  making  units  must  be  able  to  adjust  to 
and  handle' the  uncertainty  that  exists  In  Its  environment.  However,  this  line  of 
reasoning  (often  called  contingency  theory)  has  left  many  Investigators  unhappy 
with  the  definition  of  uncertainty  and  with  Its  conceptual  links  to  other  areas 
of  theory,  specifically,  decision  theory  (6).  One  problem  Is  that  little  i 
emphasis  has  been  placed  on  either  the  causes  of  uncertainty  or  Its  effects  on 

i 

the  decision  process.  That  Is,  while  we  know  that  uncertainty  exists  we  have 
little  Information  about  Its  specific  causes  and  how  that  uncertainty  Influences 
the  various  components  of  the  decision  process.  A second  problem  Is  that  the 
analysis  of  both  environments  and  uncertainty  Is  carried  out  at  the  level  of 
aggregates  of  people  (e.g.,  groups  or  organizations)  and  very  little  effort  has 
been  made  to  examine  uncertainty  as  an  Individual  psychological  or  perceptual 
variable  as  Is  done  In  decision  research  (8,  9). 

In  decision  research  uncertainty  has  typically  been  defined  In  terms  of  the 
Individual's  ability  to  specify  action-outcome  probabilities:  Certainty  exists 
when  action-outcome  probabilities  are  1.00,  risk  exists  when  action-outcome 
probabilities  are  less  than  1.00,  but  specifiable,  and  uncertainty  exists  when 
action-outcome  probabilities  are  unknown.  However,  It  has  been  suggested  that 
the  definition  of  uncertainty  as  the  Inability  to  generate  a single  probability 
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1s  too  narrow  (10) j that  Is,  In  many  cases  a decision  maker  has  an  Imprecise, 
general  Idea,  or  "ballpark"  estimate  of  action-outcome  probabilities.  The 
degree  of  Imprecision,  1,e.»  the  largeness  or  smallness  of  this  "ballpark",  can 
be  Interpreted  as  the  decision  maker's  uncertainty  about  the  action-outcome 
relationship  (1,3,  14). 

The  recent  organizational  literature  has  begun  to  reflect  this  line  of 
thought  (5).  One  component  of  Duncan's  (7)  measure  of  uncertainty  Is  based  on 
the  ability  of  the  decision  maker  to  assign  probabilities  about  the  effect  of 
various  factors  on  the  success  or  failure  of  a decision  unit.  Downey  and  Slocum 
(6)  define  uncertainty  as  a perceptual  characteristic  based  upon  an  Individual's 
less  than  complete  knowledge  of  action-outcome  relationships.  Huber,  O'Connell 
and  Cummings  (12)  use  two  procedures  reflecting  an  Individual's  probability  and 

. ' •,  II:.  ’ 

uncertainty  estimates  that  various  strategies  would  be  used  In  a tactical  and 
negotiations  game.  These  studies  evidence  an  effort  to  move  to  an  individual 

level  of  analysis  with  uncertainty  defined  In  terms  of  act Ion -outcome  relation- 

• * 

ships. 

The  purpose  of  the  present  research  Is  to  carry  this  line  of  thought  one 
step  further.  First,  uncertainty  Is  defined  as  an  Individual's  cognition  and 
seen  as  the  degree  to  which  an  action-outcome  relationship  is  specifiable.  A 
measure  called  the  "equivalence  Interval"  (El)  developed  by  Beach  and  Solak  (3) 
Is  used  to  assess  this  uncertainty.  Second,  a number  of  factors  in  the  decision 
task  and  In  the  Information  related  to  the  task  are  manipulated  In  two  separate 
experiments.  In  this  way  the  direct  causes  of  uncertainty  can  be  specified 
rather  than  the  global  estimates  of  turbulence  currently  being  used  by  many 
Investigators. 

The  variables  to  be  studies  as  causes  of  uncertainty  came  from  a number  of 
different  areas  of  research.  From  contingency  theory  research  came  two  Ideas: 
First,  we  hypothesized  that  a random,  unpredictable  environment  might  produce 
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random  or  disorderly  Information.  It  should  be  more  difficult  to  discern  a 
meaningful  pattern  In  disorderly  Information  and  uncertainty  should  result. 

The  second  Idea  from  this  literature  Involves  the  control  of  the  Information 
flow.  A random  or  disorderly  environment  Is  more  likely  to  be  uncontrollable  in 
terms  of  when  information  can  be  obtained.  This  lack  of  control  over  when  Infor- 
mation Is  obtained  may  cause  greater  uncertainty  than  when  a stable,  controllable 
flow  of  Information  Is  available. 

There  are  also  some  possible  causes  of  uncertainty  that  seem  to  be  unrelated 
to  whether  the  environment  Is  stable  or  turbulent.  These  variables  have  been 
discussed  In  the  decision  research  but  are  not  part  of  the  contingency  litera- 
ture. For  example,  one  way  In  which  decision  researchers  have  suggested,  that 
uncertainty  can  be  reduced  Is  to  decompose  the  decision  problem  Into  smaller 
units  (17).  A strategy  that  Is  often  used  Is  to  have  the  decision  maker  engage 
In  frequent  evaluations  and  judgment  revisions  as  he  or  she  proceeds  through  the 
problem.  Irt  this  manner,  the'flnal  judgment  Is  supposedly  more  accurate  and  the 
decision  maker  Is  supposedly  less  uncertain  about  the  judgment  than  If  one,  final 
whollstlc  judgment  Is  made. 

A second  factor  of  Importance  In  decision  research  has  been  the  character- 
istics of  the  source  of  Information.  The  perceived  reliability  or  status  of  the 
source  has  been  shown  to  have  a significant  Impact  on  the  judgment  process  and  on 
opinion  revisions  (2),  The  more  reliable  the  source,  the  lower  the  uncertainty. 

Finally,  In  some  cases  It  has  been  found  that  the  Internal  ordering  of 
Information  Items  has  an  effect  on  judgments.  In  many  cases  the  first  few  Items 
bias  the  processing  of  later  Items.  This  is  described  as  a primacy  effect  and  It. 
has  been  studied  In  the  areas  of  attitude  change,  decision  making  and  personnel 
selection.  The  more  that  Initial  Items  of  Information  can  be  used  as  good 
indicators  of  one's  overall  judgment  the  lower  should  be  the  uncertainty. 
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In  summary,  the  hypotheses  were  that  greater  psychological  uncertainty  occurs 
(as  measured  by  the  width  of  the  equivalence  Interval)  when: 

1.  Items  of  Information  appear  In  a disorderly  rather  than  orderly  fashion; 

2.  Someone  other  than  the  decision  maker  controls  the  flow  of  Information; 

3.  One  final  judgment  Is  made  rather  than  a set  of  sequential  judgmental 
revisions; 

4.  The  source  of  the  Information  Is  unreliable  as  opp.."  to  reliable;  and 

5.  Relevant  Items  come  last  rather  than  first. 

EXPERIMENT  1 

The  first  experiment  asked  subjects  to  read  three  short  stories  (scenarios) 
and  analyze  20  Items  of  Information  relevant  to  each  story.  At  the  end  of  each 
analysis  a number  of  judgments  were  made.  The  control  of  the  rate  of  Informa- 
tion flow  and  the  orderliness  of  the  2Q  information  Items  served  as  the  Indepen- 
dent variables.  Uncertainty  (as  assessed  by  the  equivalence  Interval)  and  rated 
satisfaction  with  the  judgments  served  as  dependent  variables. 

Subjects 

Seventy-two  junior  and  senior  undergraduate  students  from  an  Introductory 
business  course  were  randomly  assigned  to  one  of  two  conditions  (no-control, 
control)  and  engaged  In  three  decision  tasks  which  varied  In  orderliness  (high, 
moderate  or  low).  The  subjects  were  volunteers  and  were  paid  at  the  rate  of  $3 
per  hour  for  their  participation. 

Procedure 

The  subjects  were  seated  In  a small  room  where  there  was  a table,  a tape 
recorder,  a slide  projector  and  screen  and  the  experimenter.  They  were  told  that 
they  would  be  participating  In  a study  on  decision  making  and  given  a brief 
description  of  what  they  would  be  required  to  do.  At  that  time  the  concept  of 


-5- 


an  equivalence  Interval  was  explained  to  them.  They  had  one  practice  scenario 
and  made  one  set  of  judgments  to  make  sure  that  everyone  understood  the  procedure. 
Task 


Three  scenarios  (besides  the  practice  scenario)  were  developed.  Each 
scenario  consisted  of  a short  cover  story  and  20  simple  binomial  items  of  Infor- 
mation (such  as  yes/no).  The  first  scenario  was: 

The  employees  of  the  company  where  you  work  are  planning 
to  donate  a centennial  gift  to  a business  school  (an  undertaking 
that  you  personally  have  been  working  on  for  some  time).  The 
Employees  Association  has  decided  that  they  would  ask  each  of 
the  1000  employees  to  contribute  one  dollar.  You  have  been 
given  the  job  of  collecting  the  contributions.  The  president 
of  the  company  announces  that  the  company  will  match  the 
employees'  donations  but  must  know  In  an  hour  the  approximate 
amount  which  the  employees  will  contribute.  This  Is  a difficult 
task  but  you  decide  to  randomly  sample  a number  of  people  from 
various  company  departments.  The  results  of  your  request  produced 
the  pledges  indicated  on  the  slides. 

The  subject  was  shown  20  slides.  Each  slide  contained  the  department  from  which 
one  of  20  people  came  (out  of  1000)  and  a simple  $1.00  or  $.00  next  to  It.  The 
subject  was  asked  to  estimate  the  proportion  of  support  In  the  company. 

Scenario  B had  the  subject  estimate  the  proportion  of  companies  (out  of 
1000)  that  would  place  an  order  for  a specific  product  and  the  20  slides  con- 
tained the  name  of  the  company  and  a "yes"  or  "no".  Scenario  C concerned  the 
degree  of  support  for  a political  petition  at  a large  university.  A sample  of 
20  students  (out  of  1000)  was  presented  on  the  slide  (their  name  and  year)  and  a 
"yes"  or  "no". 

Measures 

Two  dependent  variables  were  used.  First,  each  subject  made  a proportion 
estimate  as  required  by  the  task.  This  was  done  on  a 100-point  scale  like  the 
one  below: 


0 10  20  30  40  50  60  70  80  90  100 
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After  this  specific  point  estimate  was  made  the  subject  was  asked  to  place 
an  equivalence  Interval  (El)  around  the  answer.  The  specific  Instructions  for 
making  this  judgment  are  available  in  Beach  et  al.  (1).  Essentially,  the  subject 
Is  asked  to  place  a bracket  (an  upper  and  lower  limit)  around  the  point  estimate. 
This  bracket  or  Interval  demarks  the'  range  of  answers  within  which  the  subject 
feels  the  true  answer  Is  reasonably  likely  to  lie.  The  mohe  uncertain  the 
subject  Is  of  his  or  her  point  estimate  the  wider  the  Interval:  the  more  certain 
the  subject  Is  the  narrower  the  Interval.  The  width  of  the  Interval  Is  the  first 
dependent  variable. 

The  second  dependent  variable  was  the  subject's  satisfaction  with  his  or  her 
judgment.  A 100-point  scale,  similar  to  the  one  above,  was  used  and  the  subject 
merely  marked  the  scale  at  some  point  to  indicate  his  or  her  satisfaction. 

Manlpul atlons 

The  subjects  In  the  no  control  condition  were  yoked  to  the  control  condition 
subjects  so  that  the  time  of  exposure  to  each  Item  of  Information  would  be  equal 
for  both  groups.  First,  subjects  were  randomly  assigned  to  pairs.  Then,  the 
first  subject  to  be  run  In  each  pair  controlled  the  speed  at  which  slides  appeared 
on  the  screen.  This  was  done  by  pressing  a button  on  a remote  slide  changer 
which  the  subject  held.  A cassette  tape  recorder  recorded  the  sound  of  each 
slide  change.  When  the  second  member  of  the  pair  was  run,  the  experimenter  had 
an  earphone  attached  to  her  ear  and  she  listened  to  the  recording  of  the  slide 
changes  made  by  the  first  subject.  Whenever  a slide  change  occurred  on  the 
recording  the  experimenter  changed  the  slide.  Thus,  half  the  subjects  controlled 
the  rate  at  which  they  were  exposed  to  the  Information  and  the  other  half  had  the 
rate  controlled  by  someone  else. 

Orderliness  had  three  levels  of  treatment  (high,  moderate  and  low)  and  was 
defined  as  the  number  of  shifts  between  positive  and  negative  Information  Items 


(see  11,  13  for  similar  definitions).  For  example,  the  following  three  strings 
of  Items  represent  high,  moderate  and  low  orderliness  (or  D for  "dlsorderllness") 
conditions: 

+ + + + +.o.+  + ,o  ooo  o.  + + + +.0.+  + D ■ 6 

T T T T t T 

1 2 3 4 5 6 

%V  VtV  °'V  + + +,+ + v++v  0-9 

1 2 3 4 5 6 7 8 9 

+ + + ++v+v + ++V+°  °+++V  ++V  o ■ 12 

1 2 3 4 5 6 7 8 9 10  11  12 

Note  that  In  all  three  strings  the  proportion  of  positive  Items  Is  the  same 
(13/20).  It  Is  only  the  order  of  their  presentation  which  Is  different. 

Each  subject  saw  a scenario  of  high  (0  ■ 6),  moderate  (D  ■ 9)  and  low 
(D  » 12)  orderliness.  This  D level  was  represented  by  the  pattern  of  yes/no 

V- 

slides  that  appeared  on  the  screen. 

Other  Experimental  Controls 

Three  other  precautions  were  taken  with  respect  to  the  design  of  the  study. 
First,  the  design  Is  basically  a 2(levels  of  control)  by  3(levels  of  orderliness) 
design  with  orderliness  being  a repeated  measure.  The  three  scenarios  can  be 
presented  In  six  different  orders  and  an  equal  number  of  these  dl fferent  orders 
was  used  In  the  control  and  no  control  conditions.  This  procedure  controlled 
for  possible  order  effects.  ■ 

Second,  in  some  cases  positive  Items  appeared  In  the  beginning  and  sometimes 
at  the  end.  To  avoid  primacy  or' recency  effects,  which  were  not  part  of  this 
first  study,  for  half  of  the  subjects  the  orders  of  Information  Items  were  the 
reverse  of  the  orders  for  the  other  subjects.  While  D remains  the  same,  the 
pattern  of  Items  becomes  a mirror  Image  of  the  Initial  ordering. 

Finally,  to  avoid  the  problem  of  subjedkf  simply  counting  the  number  of 
positive  Items  In  one  or  two  of  the  scenarios  ahhd  then  using  that  judgment  for 
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later  judgments  a number  of  procedures  were  used.  First,  subjects  were  asked  not 
to  count.  We  requested  that  "Intuitive"  judgments  be  made.  Second,  we  had  found 
from  pilot  studies  that  ft  was  hard  to  remember  more  than  15  Items  of  Information 
presented  on  a screen  In  this  fashion.  We  chose  20  Items  to  decrease  the  chances 
of  counting.  As  a last  precaution  we  varied  slightly  the  proportion  of  positive 
and  negative  Items  In  each  scenario.  Scenario  A had  a P of  .60  (12  out  of  20 
Items  were  positive);  B was  .65  and  C was  .70;  D was  counterbalanced  within  each 
scenario  across  Ss. 

To  summarize,  72  subjects  were  randomly  assigned  to  two  conditions  of 
control  and  exposed  to  three  conditions  of  orderliness.  Order  effects  and 
primacy/recency  effects  were  counterbalanced  and  precautions  were  taken  to 
prohibit  the  subject  from  using  counting  as  a decision  strategy.  The  design  Is 
presented  In  Table  1. 


Insert  Table  1 about  here 

r : 

RESULTS  OF  EXPERIMENT  1 

Two  2 x 3 analyses  of  variance  with  repeated  measures  were  conducted  with 
the  two  levels  of  control  and  the  three  levels  of  orderliness  serving  as  the 
Independent  variables  In  both,  and  either  the  El  or  satisfaction  measures 
serving  as  the  dependent  variables.  There  were  no  main  effects  for  control  or 
orderliness  and  no  Interaction  In  either  analysis.  These  tests  failed  Initially 
to  support  our  hypothesis. 

However,  the  feedback  we  had  received  from  the  non-control  (experimenter 
controlled)  subjects  had  caused  us  to  question  the  effectiveness  of  this 
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^able  1 

Assignment  of  Subjects  within  the  Control/No  Control  Conditions 
where  A,  B,  C designate  scenarios;  H,  M,  L designate 
levels  of  orderliness  (high,  medium,  low); 
and  P,  R stands  for  primacy,  recency 

Subject  Pair  Treatment  Primacy/Recency 
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had  not  In  general  tried  to  rush  through  the  experiment,  the  non-control 
subjects  experienced  little  pressure  due  to  lack  of  control.  They  reported  this 
fact  to  us. 

Therefore,  two  one-way  repeated  measures  analyses  of  variance  were  conducted 
for  the  control  subjects  with  three  levels  of  orderliness  as  the  Independent 
variables  and  either  El  or  satisfaction  as  the  dependent  variables.  In  these 
analyses  the  main  effect  for  orderliness  was  marginally  significant  (F  ■ 2.7, 
p * .07)  for  the  El  but  not  significant  for  satisfaction. 

The  means  of  the  three  orderliness  conditions  seemed  to  support  our  hypo- 
thesis. The  El  for  high  orderliness  was  16.97,  for  moderate  orderliness  It  was 
20.50,  and  for  low  orderliness  It  was  21.67.  Increasing  levels  of  uncertainty 
were  associated  with  decreasing  levels  of  orderliness.  This  result  was  as 
predicted  and  It  encouraged  us  to  pursue  these  findings  further. 

EXPERIMENT  2 

In  the  second  experiment  subjects  were  asked  to  evaluate  the  probable  job 
success  of  eight  hypothetical  job  candidates.  Each  candidate  was  described  In 
terms  of  20  Items  of  descriptive  or  biographical  Information,  The  Independent 
variables  were  the  orderliness  of  the  Information  (high  vs.  low),  the  status  of 
the  source  of  Information  (high  vs.  low),  the  particular  pattern  of  Information 
Items  (primacy  vs.  recency)  and  the  way  In  which  judgments  were  made  (sequential 
vs.  final).  The  dependent  variables  were  the  El  placed  around  the  judged 
probability  of  success  and  the  rated  satisfaction  with  that  judgment. 

Subjects.  „ 

Eighty-four  junior  and  senior  undergraduates  from  Introductory  business 
courses  participated  as  subjects.  They  were  volunteers  and  were  paid  $3  per 
hour.  They  were  randomly  assigned  to  either  the  sequential  or  final  judgment 


treatments. 


-10- 


I 

I 

I 


1 


Procedure 

The  experiment  was  conducted  In  a room  with  a large  table,  a slide  projector, 
and  a screen.  The  subjects  were  run  in  groups  of  one  to  nine.  They  were  brought 
in,  given  an  explanation  of  the  experiment  and  given  an  answer  booklet.  Each  cf 
the  20  Items  of  Information  for  each  candidate  was  shown  on  the  screen  for  seven 
seconds  with  a three  second  pause  between  slides.  At  the  end  of, each  set  of  ; 

slides  they  made  ratings  of  that  particular  candidate  and  then  proceeded  on  to  the 

r ■ 

next  person.  The  experimenter  controlled  the  rate  pt  which  the  slides  were 
presented. 

Task 

This  task  was  somewhat  more  meaningful  than  the  pne  used  in  the  first  experi- 
ment. The  subjects  were  told  to  Imagine  that  a large  corporation  had  placed  an 
advertisement  In  the  local  newspaper  asking  for  management  trainee?.  A copy  of 
the  ad  was  provided.  They  were  told  that  over  60  applications  hid  been  received 
and  that  everyone  had  gone  through  extensive  tests  conducted  by  outside  employ- 
ment agencies.  The  choice  had  been  narrowed  down  to  eight  people  and  It  was 
these  people  that  the  subjects  would  be  asked  to,  rate. 

The  subjects  were  told  that  they  would  be  asked  to  rate  each  candidate  based 
on  the  candidate's  characteristics  on  a set  of  20  criteria  (e.g. , health, 
education,  ambition,  flexibility,  experience,  etc.).  They  were  Informed  that 
the  corporation  had  developed  these  20  criteria  over  a series  of  years.  Table  2 
presents  the  20  criteria  and  a representative  Information  Item  for  each.  For 
all  eight  candidates  there  were  14  positive  and  6 negative  ones.  Thus,  as  In  the 
first  experiment  the  stimuli  In  this  experiment  consisted  of  strings  of  positive 
or  negative  Items  of  Information. 

Insert  Table  2 about  here 
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Table  2 

List  of  20  Criteria  and  Examples  of  Information  Items  for  Candidate  Number  Four 


Candidate  No.  4 

■ ■ Item  Rating 

Innovation  ~ 

Our  Company  looks  for  people  who  have  new  and  relevant  Ideas. 

Received  a bonus  for  a number  of  new  brlglnal  Ideas  on  past  jobs.  2.7 


Beha vi or Tl  1 us trates  a sense  of  direction  or  purpose,  f.e.,  Is 

able  to  specify  priorities  correctly.  2.6 

Flexibility  11  " ,v"  ' ’ 

This  candidate  follows  the  rules  but  Is  not  afraid  to  overlook  a . 
rule  or  bend ’ i t If  the  situation  should  warrant  this.  The  company 
prefers  people  who  are  flexible.  „ . 2.4 

Education 

is  presently  taking  the  first  year  of  a M.Sc.  In  Business 
Administration.,,  Our  company  prefers. that  trainees  have  at  least 
completed  their  bachelor 's  degree.  ' ' " 1 " 2.4 

Health  ' ( ■■  • ••  ••<i  • 

Health  seems  to  be  excellent.  Looks  and  acts  fit.  Should  be  able 
to  work  the  long  hours  required  of  this  position.  2.3 

Selection  Exerclsbs 

Has  the  scholastic  aptitude  and  forceful  ness  to  become  a 

successful  manager.  This  was  confirmed  In  the  selection  exercises 

which  the  applicant  performed,  1.9 

Challenge 

Likes  challenge.  Managers  who  like  challenge  tend  to  be  more 
successful.  1.6 

Literary  Interests 

Prefers  id  reacT  autobiographies  and  books  concerning  travel  and 
foreign  countries.  This  background  should  be  particularly  helpful 
In  meeting  clients  and  managers  from  foreign  countries.  1.5 

Risk-taking  Propensity 

Has  not  been  willing  to  take  risks  In  the  past  even  after  analyses 

Indicates  that  risky  action  Is  most  appropriate.  Managers  with 

this  company  must  be  willing  to  take  risks.  -2.1 

Interpersonal  Orientation 

Does  not  get  along  well  with  colleagues.  This  type  of  manager 

may  experience  problems  In  adjusting  to  new  situations.  -1.6 

Individual  Autonomy 

Seems  unsure  of  ability  to  perform  alone.  Wants  others  to  share 

the  responsibility  for  decisions  made.  -1.7 


Table  2 (Continued) 


Athletic  Activities 

Is  "sports  minded.  Is  golf  champion  for  age  group.  Also  plays 
tennis  and  badminton.  The  company  prefers  all-round  persons  and 
judges  participation  In  sports  as  Important. 


Item  Rating 


1.7 


Group  Identification 

Appears  to  lack  loyalty  to  the  organization  as  a whole.  Our 

company  prefers  that  Individuals  be  loyal  to  the  organization 

rather  than  their  particular  work  group.  -1.6 

Ambition 

Ambition  Is  to  become  highly  paid  and  respected.  Would  like  to 
be  president  of  the  company  someday.  2.3 

Extra-curricular  activities 

Has  held  numerous  executive  positions  and  participated  extensively 

In  committee  work  while  In  school.  This  Is  regarded  as  good 

outside  experience.  2.3 


Career  Orientation 

Is  very  career  oriented  and  Is  always  looking  for  an  opportunity 

to  work  on  challenging  jobs.  2,6 

Leaderless  Group  Discussion 

In  a leaderless  group  discussion,  however,  the  applicant  failed 

to  be  recognized  as  a leader  by  the  peer  group.  Any  contributions 

that  were  made  were  Insignificant.  -2.3 

Appearance 

Came"  for  job  Interview  poorly  dressed.  Had  a disorganized 

appearance.  -2.5 


Administrative  Skills 

Possesses  the  skills  needed  for  dally  administrative  duties; 

Is  orderly  and  methodical.  2.4 

Experience 

Has  been  out  of  school  for  one  year.  Worked  for  the  Government 

In  the  Systems  Analysis  Division  and  wrote  some  outstanding 

reports  and  programs  for  systems  Improvement.  2.7 


The  major  experimental  control  problem  was  to  ensure  that  each  of  these  20 
Items  of  Information  were  reliably  seen  as  either  positive  or  negative  and  that 
each  candidate  was  seen  as  being  about  equally  attractive  as  any  other  candidate. 
A number  of  steps  were  taken  to  ensure  that  this  was  the  case. 

First,  the  subjects  were  Informed  that  the  corporation's  experience  with 
candidates  had  shown  that  these  20  criteria  were  equally  Important  for  success  on 
the  job.  The  higher  the  number  of  favorable  attributes,  the.  greater  the  proba- 
bility that  the  candidate  would  be  successful.  The  subjects  were  requested, 

i . . • 1 

therefore,  to  weight  each  Item  equally  when  making  their  success  judgments. 

Also,  an  attempt  was  made  to  ensure  that  the  criteria  were  In  fact  equal. 

To  ensure  comparability  a group  of  15  business  students  (who  did  not  participate 

' ' . \ • " 

In  the  experiment  Itself)  had  been  asked  to  rate  160  Items.  There  were  four 
positive  and  four'ne^atlve  Items  presented  for  each  of  the  20  criteria  and  they 
were  rated  on  a 6-point  bipolar  scale  ranging  from  -3  (very  unfavorable)  to  +3 
(very  favorable).  Thirteen  Items  were  randomly  selected  to  be  presented  twice 
and  the  average  test-retest  reliability  coefficients  for  these  Items  was  .73  with 
12  of  13  significant  at  the  .05  level  and  one  nearly  so.  These  coefficients 

! r 

provided  confidence  In  these  judges1  ratings. 

Then  the  mean  judgments  for  each  of  the  Information  Items  was  calculated. 

All  Items  that  had  values  greater  than  * 1.7  were  Included  as  Items  which  were 
clearly  positive  or  negative.  Items  with  values  falling  to  reach  + 1.7  or  with 
high  variance  were  discarded.  This  procedure  was  then  repeated  with  a second 
group  of  15  judges  and  the  surviving  Items  were  used  as  a pool  from  which  the 
experl mental  Items  were  drawn. 

Beside  the  problem  of  having  reliably  positive  and  negative  Items  within 
each  candidate's  profile  It  was  necessary  to  ensure  that  the  eight  descriptions 
were  roughly  parallel  to  one  another.  The  ratings  made  by  the  preliminary  sample 
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of  business  students  were  used  to  establish  comparability.  To  the  extent  possl-  ; . 
ble,  a maximum  deviation  of  + .3  was  allowed  among  items  across  scenarios.  In 
other  words,  all  items  which  appear  first  In  each  of  the  eight  scenarios  had 
been  given  a mean  range  of  2.5  to  2.8  by  the  pilot  sample;  all  items  which  appear 
second  had  been  given  a mean  range  of  2.4  to  2.6,  etc.  Table  3 below  gives  a 
summary  of  the  mpans  for  the  positive  and  negative  Items  of  Information. 
Differences  In  the  overall  means  among  the  positive  Items  for  the  eight  candidates 
are  barely  discernible  (the  high  is  2.29  and  the  low  Is  2.24,  a difference  of 
only  0.05).  There  Is  slightly  more  variation  In  the  overall  means  among  the 
negative  Items  (high  of  -1.87  and  low  of  -2.15,  or  a difference  of  0.28).  This 
variation,  however,  Is  still  fairly  small. 

Insert  Table  3 about  here 

Manipulations 

There  were  four  Independent  variables  and  the  manipulation  of  each  one  Is 
described  below. 

Judgment  Procedure— Subjects  were  assigned  to  either  a sequential  judgment 
condition  or  a final  judgment  condition.  In  the  sequential  condition  each  subject 
rated  a candidate's  probability  of  success  after  viewing  each  Item  of  Information. 
In  the  final  condition,  one  summary  judgment  was  made  after  all  twenty  Items  of 
Information  about  a particular  candidate  had  been  observed. 

To  facilitate  the  sequential  judgments,  subjects  were  provided  with  sets  of 
scales  for  each  of  the  eight  candidates  that  they  would  evaluate.  Each  scale  was 
calibrated  so  that  any  probability  level  from  0.0  to  1.0  could  be  marked.  Addi- 
tionally, the  beginning  of  the  scale  (0.0)  was  defined  as  a "very  low  probability 
of  success";  the  end  of  the  scale  (1.0)  was  designated  as  a "very  high  proba- 
bility of  success". 


.iiii  ' ■ 


Table  3 

Overall  Means  for  Information  used  In  Candidate  Profiles 


Candidate 

Number 


Overall  Mean 
Positive  Items 


Overall  Mean 
Negative  Items 


The  subject  In  the  sequential  condition  saw  each  slide  (item  of  Information), 
revised  his/her  opinion  regarding  the  probability  that'  the  particular  management 
trainee  would  be  successful  and  marked  this  on  a scale.  To  prevent  the  subject 
from  seeing  a pattern  which  might  be  developing,  previously  marked  scales  were 
turned  face  down  when  the  recording  of  the  judgment  was  completed.  In  the 
analyses,  the  evaluation  of  each  of  the  Items  was  disregarded  and  only  the  last 
judgment  made  was  analyzed.  The  subjects,  at  the  time  of  the  experiment,  were  not 
aware  how  the  data  would  be  treated. 

Source  Status— The  status  of  the  source  was  manipulated  through  the  presen- 
tation of  information  about  the  source  prior  to  the  subject's  viewing  of  a 
candidate's  20  Information  Items.  Before  seeing  the  slides  a one-page  description 
of  the  source  of  Information  (the  person  and  the  company  Involved)  were  presented 
to  the  subject.  Four  of  these  sources  were  designed  to  be  of  high  status  and 
four  of  low  status. 

Fifteen  judges  (business  students  who  did  not  participate  In  the  experiment) 
were  asked  to  rate  these  source  descriptions  on  two  six-point  bl -polar  scales 
(+3  to  -3)  In  terms  of  (1)  the  degree  to  which  the  agency  and  Individual  Involved 
had  high  prestige  and  (2)  the  reliability  of  this  Information  source.  Analyses 
of  variance  showed  that  for  both  questions  the  sources  were  significantly 
differently  rated.  The  means  for  the  prestige  question  were  2.51  for  high  status 
sources  and  -.98  for  low  status  sources  (F  ■ 231.09,  p < .001).  The  means  for 
the  reliability  question  were  2.61  for  high  status  sources  and  -.49  for  low  status 
sources  (F  ■ 258.50,  p < .001).  An  example  of  a high  status  source  Is  presented 
below: 

Evaluation  of  the  fourth  candidate  Is  by  Harold  Kubber: 

Harold  Kubber  Is  National  Secretary  of  the  International 
Association  of  Personnel  Administrators.  A special  department 
within  IAPA  has  been  set  up  to  carry  out  research  on  the  assess- 
ment of  managerial  talent.  Each  year,  this  department  offers  Its 
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services  free  of  charge  to  a limited  number  of  member  companies. 

Although  It  makes  only  a few  evaluations,  for  these.  It  spares  no 
expense— the  best  available  experts  and  testing  devices  are  always 
utilized  in  the  evaluation  of  candidates. 

Kubber  graduated  five  years  ago  with  a M.B.A.  from  the 
University  of  Vermont.  He  Is  well-known  In  management  assessment 
circles.  Kubber's  leadership  and  Innovative  Ideas,  particularly 
In  this  management  assessment  program,  have  earned  IAPA  and  Kubber 
himself  the. recognition,  admiration,  apd  respect  of  member  . 
organizations. 

Orderliness— This  variable  was  defined  In  the  same  fashion  as  In 
Experiment  1.  The  Items  were  put  together  In  a string  with  a D either  of  12  or 
6 with  the  former  representing  low  orderliness  and  the  latter  representing  high 
orderliness. 

Prlmacv/Recency— The  two  strings  mentioned  above  (high  or  low  D)  were  both 
constructed  to  have  long  runs  of  positive  Information.  For  half  the  subjects 
these  runs  came  at  the  beginning  of  the  profile  presentation.  The  other  half 
saw  the  exact  opposite  order  which  placed  these  runs  at  the  end  of  the  profile. 

The  sequence  for  candidate  4 (where  D.  ■ 6)  for  example  was  as  follows: 

Primacy  ++++++++000+0+++00++  D ■ 6 

, _ \ 

Recency  ++oot++o+ooo++++++++  D ■ 6 

Each  subject  saw  four  profiles  with  a primacy  ordering  and  four  with  a recency 
ordering. 

Measures 

The  same  measures  used  In  Experiment  1 were  used  In  Experiment  2.  The 
subject  rated  the  probability  of  each  candlcate  succeeding  on  the  job  on  the 
100-point  calibrated  scale  shown  before.  An  equivalence  Interval  was  placed 
around  this  judgment  and  a separate  100-point  scale  assessed  their  satisfaction 
with  their  judgment. 

Overall  Design 

Each  of  the  four  Independent  variables  has  two  treatment  levels  which  results 
In  16  experimental  conditions.  Schematically,  this  can  be  shown  as  follows: 
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Final 

Sequential 

High  Orderliness 

Low  Orderliness 

High  Orderliness 

Low  Orderliness 

HI gh  Status  Low 

High  Status  Low 

High  Status  Low 

Prim  Rec  Prim  Rec 

Prim  Rec  Prim  Rec 

Prim  Rec  Prim  Rec 

Prim  Rec  Prim  Rec 

1 2 3 4 - 5 6 — 7‘  8 9 1.0  11  12  13  14  15  16 

• .•  ii  • ..  • . ..  I 

The  orderliness,  status  and  prlmacy/recency  variables  are  repeated  measures  and 
subjects  are  nested  within  the  final /sequential  variable. 


$ • » • ’ • ' • i-  * ‘ ’ 

x Treatments  and  order  of  candidates  for  all  small  group  sessions  were  . ran- 

V . i ....  , . . . 

-I  • i ..  1 \ 

!'■  j.  domly  assigned  to  the  respective  group.  Each  small  group  was  either  In  the 

s i !' 

I sequential  or  final  judgment  condition  and  responded  to  an  Identical  set  of 

Li. 

; i 2x2x2  experimental  conditions  (hlgfi/low  orderliness  x prlmacy/recency  x 

•;  ' high/low  status).  The  order  of  presentation  was  scrambled  for  each  group. 

i 

i. 

» • RESULTS  : ' 

1/  1 

t.  ■ I • 

The  two  dependent  variables  were  subjected  to  a 2 x 2 x 2 x 2 analysis  of 

c,  i ■ i t 

variance  with  repeated  measures.  Since  the  complexity  of  three-way  and  four-way 

•I,  . ! •• 

; Interactions  In  most  cases  defies  meaningful  explanation  (and  only  two  three- 

1 • i t 

ways  were  significant)  we  will  stick  to  a discussion  of  only  the  main  effects  and 

!,‘  • 1 1 1 ‘ 1 

two-way  Interactions. 

• ' * , 

■ For  the  El  measure  of  uncertainty,  orderliness  and  source  status  were 

/ 1 * 

{ significant  while  the  prlmacy/recency  and  sequential /final  treatments  were  not. 

i There  were  no  two-way  Interaction  effects. 

'i  ! : ■ ■ « 

■ I The  subjects  In  the  high  orderliness  condition  had  a mean  El  of  20.15  and 

* i in  the  low  orderliness  condition  this  mean  was  21.87  (F  ■ 5.33,  p < .03).  The 

high  orderliness  condition  produced  slightly  but  significantly  less  uncertainty 

‘ ’ , ,i 

than  the  low  orderliness  condition.  This  result  was  as  predicted  and  replicates 
I the  finding  from  Experiment  1. 
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The  mean  El  for  the  profiles  with  high  status  sources  was  18.52  arid  for  low 
status  sources  It  was  23.50  (F  ■ 29.04,  p < .001)'.  High  status  sources  produced 
less  uncertainty  than  ldw  status  sources.  This  result  also  was  as  predicted. 

For  the  satisfaction  dependent  variable  the  only  main  effect  that  was 
significant  was  for  the  status  of  the  source.  There  were  no  significant  two-way 
Interactions.  The  means  for  the  satisfaction  measure  were  In  the  predicted 
direction.  The  mean  satisfaction  for  high  status  sources  was  71.72  and  for  low 

• > ■ .m  j ■ . * f 11  . 1 i : 

status  sources  It  was  61.40  (F  - 42.87,  p < .001).  A high  status  source  resulted 
In  higher  satisfaction  with  the  judgment  than  a low  status  source. 

DISCUSSION 

In  Experiment  1 we  found  that  orderliness  was  marginally  related  to  the 
uncertainty  criterion  while  control  was  unrelated  to  It.  In  Experiment  2 
orderliness  again  was  found  to  be  related  to  the  uncertainty  variable  as  was  the 
status  of  the  source.  The  primacy/recency  and  sequentlal/flnal  manipulations 
failed  to  produce  a reliable  change  In  uncertainty.  The  satisfaction  variable 
was  affected  by  only  the  source  status  manipulation  In  the  second  experiment. 

From  a methodological  perspective  the  findings  suggest  that  uncertainty  can 
be  defined  and  measured  In  a fashion  which  produces  reliably  replicable  results. 
The  Important  point  Is  that  uncertainty  can  be  seen  as  the  degree  to  which  a 
decision  maker  feels  comfortable  with  the  assignment  of  a specific  action-outcome 
probability.  This  new  definition  contrasts  rather  markedly  with  the  traditional 
view  that  uncertainty  only  occurs  when  the  decision  maker  Is  unable  to  assign 
these  probabilities. 

The  substance  of  the  results  needs  comment  as  well.  The  fact  that  the  order- 
liness of  the  Information  was  related  to  uncertainty  In  both  studies  Is  Important. 
These  two  experiments  Involved  different  people  working  on  different  decision 
problems.  The  findings  suggest  that  oneway  In  which  a random,  unstable, 
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external  environment  causes  uncertainty  Is  through  the  lack  of  order  or  patterning 
of  Information  Items  that  are  used  by  the  decision  maker.  Future  contingency 
studies  should  pursue  this  Idea. 

It  Is  apparent  that  the  status  of  the  source  Is  also  an  Important  factor  In 
producing  uncertainty  about  judgments  and  In  producing  satisfaction  with  those 
judgments.  This  result  1$  not  surprising,  It  has  been  found  before.  What  Is 
Important,  however,  Is  the  theoretical  Implications  of  the  finding.  Most  contin- 
gency theories  using  environmental  uncertainty  concepts  do  not  Include  factors 
like  source  status;  one  would  be  hard-pressed  to  coma  up  with  a rationale  for 
why  a random  or  a stable  environment  should  result  In  Information  sources  of 
high  or  low  status.  There  does  not  seem  to  be  a logical  connection.  Yet  the 
findings  from  Experiment  2 suggest  that  source  status  was  far  and  away  the  most 
Important  cause  of  psychological  uncertainty.  The  variance  In  uncertainty 
controlled  by  the  source  status  manipulation  was  26*.  This  figure  was  only  6* 
for  the  orderliness  manipulation. 

At  the  beginning  of  this  article  It  was  mentioned  that  many  contingency 
theorists  define  uncertainty  In  terms  of  environmental  variables  such  as 
complexity,  randomness  and  unpredictability.  The  present  findings  suggest  that 
such  conceptualizations  are  Incomplete  because  a major  contributor  to  uncertainty, 
source  status,  has  been  overlooked.  For  this  reason  we  would  argue  that  the 
cuases  of  uncertainty  and  the  concept  of  uncertainty  Itself  should  be  theoreti- 
cally and  methodologically  distinct  and  separate.  In  this  fashion  a more 
comprehensive  theory  of  decision  uncertainty  can  hopefully  evolve. 
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